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§0. Introduction 

Let g be a complex semisimple Lie algebra with adjoint group G. Suppose that 
a 7^ id is an involutive automorphism of g. Then a induces uniquely an involution 
of G also denoted by cr, let K = G a be a subgroup of cr-fixed points. Consider a 
direct decomposition g = 6 © p of g into eigenspaces for cr, so 

6 = {x E g | a(x) = x}, p = {x G g \ a(x) = —x}. 

Then, clearly, £ is a Lie algebra of K and p is a -ff -module, this representation 
is certainly nothing else but an isotropy representation of a symmetric space G/K 
(see e.g. [KR]). Denote by a C p any maximal abelian ad-diagonalizable subalgebra. 
Consider the "baby Weyl group" W = N K (a)/Z K (a). It is well-known that W 
is a finite group generated by reflections as a linear group operating on a (with 
respect to some real form of a). Let i(j : C[p] K — > Cfa] 1 ^ be a restriction map of 
algebras of invariants. Then the famous Chevalley restriction theorem states that 
ip is an isomorphism (see eg. [Hel], in [Vi] a more general result is obtained in the 
context of so-called ^-groups attached to any periodic automorphism of g). 

Now consider the following special case. The adjoint representation G : g could 
be identified with an isotropy representation of a symmetric space induced by an 
involution a on GxG given by a(x, y) = (y, x). Then the cited Chevalley restriction 
theorem is equivalent to the "usual" Chevalley restriction theorem C[$j] G ~ C[f)] w , 
where f) C is a Cartan subalgebra and W is the usual Weyl group. In the pa- 
per [J] A. Joseph obtained the remarkable "multivariable" analogue of this theorem. 
Namely, he proved that the restriction map 

C[ fl x g ] G ^C[l,xf 

is surjective. This theorem has important applications to the representation theory 
and the geometry of commuting varieties (cf. [Ri]), because it is essentially equiv- 
alent to the fact that the ring of G-invariant functions on a commuting variety is 
integrally closed (see [Hu, J]). The aim of this paper is to extend Joseph's arguments 
in order to prove the following generalization: 

Theorem. The restriction map %j) : C[p x p]^ — > C[o x a]^ is surjective. 

Actually, this (and Joseph's) theorem also holds for any number of summands 
(generalization of the proof is immediate), but we will prove the Theorem in this 
form in order to make the notation easier. 
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Certainly, one could try to deduce this Theorem directly from Joseph's result 
arguing as follows: take / G C[o x a]^ , lift it to an element C[f) x f)] w , then 
by Joseph's theorem this element could be lifted to an element of C[g x q] g and 
we could resrict it to an element of C[p x p]^. Unfortunately, the first step of 
this construction fails even in the case of one summand (see examples in [He2]). 
Moreover, I don't know how to prove the natural analogue of the Theorem in the 
context of arbitrary ^-groups (see [Vi]) and this seems to be an interesting problem. 
I should mention also that in some particular cases these results could be proved 
using "generalized polarizations" (see eg. [Hu]), but these results don't cover our 
Theorem (as well as Joseph's). In [Pal] Theorem was proved in the case of an 
involution of maximal rank. 

The paper is organized as follows. In §1 we will look for a proof of Chevalley 
restriction theorem in the case of one summand such that this proof could be 
generalized to the case of two summands. Another reason for doing that separately 
is that all the ideas distinct from the ones used by Joseph will already appear in 
this case. In §2 we will prove the Theorem in full generality showing that our 
main tool (class 1 representations) is compatible with Joseph's idea to use the PRV 
Conjecture (or, better said, the Kumar-Mathieu Theorem) to "separate layers". 

I would like to thank D. Saltman for useful discussions and his warm hospitality 
during my stay in the University of Texas in Austin. The research was supported 
by CRDF grant RM1-206, and by INTAS grant INTAS-OPEN-97-1570. 

§1. SURJECTIVITY OF ip : C[p] K -> C[a] W ° 

Recall, that there is 1-1 correspondence between involutions of and real forms of 
(see [W, §1.1]). Namely, suppose that g R is a real form of (that is, = g R + ig R ), 
let R = t R © p R be a Cartan decomposition, let g = t © p be its complexification. 
Then the map a defined by a(x) = x for any x G t and a(x) = —x for any x G p 
is an involution and any involution can be obtained this way. Now, a maximal 
ad-diagonalizable abelian subalgebra a in p can be chosen to be a complexification 
of some a R C p R . From now on by complex conjugation we will understand the 
complex conjugation with respect to a given real form g R . 

Let B be a Killing form on g. Then the restriction of B on t R is negative-definite 
and on p R is positive definite. In particular we can identify — 0* and a ~ a* by 
means of this scalar product. Then the restriction map ip : C[p] K — > Cfa]^ can 
be viewed as a homomorphism of symmetric algebras tp : (Sp) K — > (Sa) w °. Now, 
it is well-known that K = G a is a reductive group (see eg. [Vu]), so we have a K- 
module decomposition Sp = (Sp) K ®(Sp)k, where (Sp)x is a sum of all non-trivial 
K-submodules. Consider the Reynolds operator (if-equivariant projection on the 
first factor of this decomposition). Let 6 : (Sa) w ° — > (Sp) K be its restriction to 
(Sa) w °. It is clear that we have a commutative diagram 

Sa {Sp) K 

02 \ SO 

(Sa) Wo 

where 6>i is a restriction of the Reynolds operator to Sa and 62 is a IUo-equivariant 
projection. Now we are ready to prove the following lemma: 
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Proof. It is clear that both maps tp and 9 are homogeneous (with respect to natural 
grading of Sa and Sp). So the composition ip9 is a homogeneous map of degree 
from (Sa) w ° to (Sa) w °. Now it is clear that if 9 is injective and Ker-0 n Im6> = 
then ipO is injective, hence surjective, so ip is surjective as well. Certainly the 
second assertion follows from the fact that tp is injective (and this is an easy part 
of Chevalley restriction theorem), but we are looking for a proof that could be 
applicable in the case of two summands. 

First we could extend B to the scalar product in in the usual way. Since 
the restriction of B on p R is positive definite, it is clear that the restriction of B 
on Sp R is also positive definite (more precisely, the restriction of B on any finite- 
dimensional subspace of Sp R is positive definite). In particular, if V C Sp is any 
subspace stable under complex conjugation, then V fl V 1 - = 0. Take V to be a 
minimal K-submodule of Sp generated by Sa. Since Sa is stable under complex 
conjugation, so is V, because V is spanned by the vectors of the form k ■ f, k G K, 
f G Sa, and since a commutes with complex conjugation on g, K is stable under 
complex conjugation (we are in the adjoint group!). 

By definition of Reynolds operator, Im6> = V fl (Sp) K . By the construction of 
B on Sp, it is clear that Kerifj = (Sa) 1 - fl (Sp) K and by i^-invariance of B we have 
Ker-0 = V 1 - n (Sp) K . Since V n V 1 - = 0, we finally obtain Ker ip n Im6> = 0. □ 

So to prove the surjectivity of ip it remains to prove that 9 is injective. This 
idea (as well as many others in this paper) belongs to Joseph, the only exception 
is that Joseph didn't use Reynolds operator directly. Instead of that he defined 
the "Letzer map" purely in infinitesimal terms, but it is easy to see that in the 
adjoint situation Joseph's "Letzer map" actually coincides with good old Reynolds 
operator! 

Now it is time to slightly change our notations and to introduce new ones. First of 
all, since Sp is a K-submodule of Sg, injectivity of 9 will follow from the injectivity 
of the restriction on (Sa) w ° of the Reynolds operator Sg — > (Sq) k . Since the 
definition of the Reynolds operator depends only on the K-module structure of Sg, 
we can substitute for Sg the universal enveloping algebra Ug, since Ug has the 
same -KT-module structure by the Poincare-Birkhoff-Witt theorem (this iiT-module 
isomorphism could be written down explicitly as a symmetrization map Sg — > Ug) . 
Moreover, we have an isomorphism 5a ~ Ua. Notice that the obvious embedding 
Ua C Ug corresponds to an embedding Sa C Sg via the symmetrization map. So 
from now on 9 will denote the map (Ua) Wo -> (Ug) K induced by the Reynolds 
operator. We need to show that it is injective. 

Fix a torus S C G such that a = Lie S. Then S is a maximal cr-anisotropic torus 
in the terminology of [Vu] . Fix a Borel subgroup B and maximal torus T C B such 
that KB is dense in G (so K is spherical in G and if b is a Lie algebra of B then 
t+b = g),T contains S (such B, T exist by [Vu]). Then automatically a(T) = T. 
Let f) = LieT be a Cartan subalgebra of g, let f)o = f) n fc, so f) = f)o © a. Let X*(T) 
(resp. £*(T)) be a character group (resp. the set of one-parameter subgroups of T). 
We use an additive notation for multiplication in X* (T) and will sometimes identify 
a character with its differential. Let P C X*(T) be the weight lattice, let P + C P 
be the dominant weights. Fix the sublattice Q C P such that A G Q if and only if 

a(X) = -A, \\ s e2X*(S). 

It is clear that for any A G Q we have A|f> = 0, so we may view such A as an 

„1„™ i- \ „£ ~* T „i- /- T J/" f. rpl „.„ „„„ — — j J ~ j_„ „„ „1„™ i. .. „f 
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X*(T) ® Q. But it is clear that actually fx G Q. Moreover by the structure theory 
of a baby Weyl group (see eg. [Wa, §1.1]), there exists w E W such that fx = wX. 
Another useful tip is that if two elements of a* are conjugate with respect to W, 
then they are also conjugate by an element of Wq (this follows from the fact that 
any Wo-fundamental chamber in o* entirely lies in some VF-fundamental chamber, 
see [loc. cit.]). Set Q + = Q n P+. 

Lemma 1.2. In the identifications above, Q = WqQ+- 

Proof. This follows from the results of T. Vust (see [Vu]). Namely, passing to dual 
lattices, it is sufficient to prove that if R G £*(£) is any one-parameter subgroup 
then there exists w G Wq such that R w = wRw -1 is dominant, that is, for any 
b G B the limit lim R w (t)bR w (t)~ 1 exists. Consider a sub group 

P(R) = {g e G I lim R^gRit)' 1 exists}. 

Then P(R) is parabolic, moreover, P(R) and aP{R) are opposite parabolics, so 
that P(R) fl crP(P) = Zq(R), the centralizer of R in G. Such parabolics are 
called cr-anisotropic. Since Zg(R) is a cx-invariant reductive subgroup and S C 
Zg{R), there exists minimal cr-anisotropic parabolic subgroup P' of Zq[K) such 
that P' fl aP' = Zz g (r)(S). Then P" = P'R U (P(R)) is a minimal cr-anisotropic 
parabolic subgroup in G and P" fl oP" = Zq{S). Since Zq{R) C P{R), we have 
P" C P(P). Now, it is known that K°SR U (P") is open in G, where K° is an 
identity component of K (algebraic analogue of Iwasawa decomposition), so if B' 
is a Borel subgroup of Zq(S) then B" = B'R U (P") is a Borel subgroup in G that 
contains S 1 , is opposite to K, and is contained in P(R). It remains to notice that 
all pairs (B, T) such that B is a Borel subgroup opposite to K, T C -B is a maximal 
torus that contains a maximal cr-anisotropic torus, are conjugate with respect to K 
(see [loc. cit.]). In particular, there exists w G Nk{S) such that S = wB". Since 
.B" C P(R), B C PtwRw -1 ) and hence i?™ = wRw -1 is dominant. □ 

Returning to proof of Theorem, for any spherical subgroup H of G and any 
irreducible representation V\ of G with highest weight A, it is known that dim < 
1 and the set 

T H = {A G P+ | dimV^ = 1} 

is a sub monoid in (see eg. [Pa2]). In our case by [Vu], it is known that Tk = Q+- 
Irreducible representations V\ such that A G Q+ are known as representations of 
class 1. Fix A G Q+, for any v G V\ and /J, G P, let (v) M denote a /(/-weight 
component of v and Supp u = {fx G P | (w) M 7^ 0}. Let be a highest weight vector 
in V\. Fix a K-invariant vector % ^ in V\. 

Lemma 1.3. 

(i) Supp^K c Q; 

A G Supp vk\ 
(Hi) Supp^x n WX = W X. 

Proof. Fix fi G Suppi^. Since \)§vk = we have /u(f)o) = 0, and so a fx = —fx. 
Moreover, if r G S has order 2, then r G -ftT, so ri>x = vk and /U G 2X*(S I ). This 

,.„„ /;\ t~i„ l„j- — -i-; — -i-U„-t- ;-f dO :„ „ o 1 „..u„ „;-t„ td 
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(so that BOB = T), then KB is dense in G (this follows from the description of 
B as in proof of Lemma 1.2). Then g = b° + t, so Ug = Ub°Ut Then 

V x = (Ug)v K = (Ub°)v K . 

But for any x G Ub°, Suppa^x < Suppt^ (with respect to a usual order relation 
on P), so A G Suppt^. The last assertion follows from (i), (ii), iVx^-invariance 
of vk and the discussion before Lemma 1.2. □ 

Now we can finish the proof of the theorem in the case of one summand. Suppose 
that / G Ker#, / ^ 0. To obtain a contradiction, it is sufficient to prove that / 
(viewed as an element of Sa) vanishes at A for all A G Q. Since / is Wo-invariant we 
need to prove that /(A) = for all A G Q+ (by Lemma 1.2). Arguing by induction 
on the standard order relation in P + , we may assume that f(fi) = for all \x G Q+, 
fj, < A. Suppose that /(A) ^ 0. Let n denote the X-invariant projection VX — > V X K . 
Let F denote the operator on V\ of left multiplication by / (viewed as an element 
of Ug). Then, clearly, F(v\) = f(p,)v\. Since Of = and since Reynolds operator 
commutes with i^-module homomorphisms, we have txFtc = (because nFn is 
clearly X-invariant, so Reynolds operator maps it onto itself, on the other hand, 
Reynolds operator commutes with left (and right) multiplication on (K-invariant!) 
element n). Hence ttFvk = 0. By Lemma 1.3 and by induction we have 

Fv K = p/(A) 

wew 

where w is some representative of w in Nk(S) and p ^ 0. Since 7r is K-invariant, 
we get n(v\) = 0. Therefore (Ut)v\ ^ V\. But 

V x = (Ug)v x = (U(t+b))v x = (m)(Ub)v x = (W)v x . 

Contradiction. 

§2. SURJECTIVITY OF lp : C[p X p] K -> C[o X o]^ 

First, we can identify C[p x p] with S(p x p), and C[a x a] with S(a x o) by 
means of Killing form. Then we can identify S(a x o) with U(a x o). Let 6 denote 
a restriction on U(a x a)^ of a Reynolds operator U(g x g) — > U(g x g)^ (with 
respect to diagonal action). 

Lemma 2.1. If 9 is injective then tp is surjective. 

Proof The proof is the same as of Lemma 1.1 and the discussion after it. □ 

Now suppose that / G Ker#. By Lemma 1.2 we know that Q+ x Q+ is Zarisky 
dense in C ® {Q+ x Q+)- Hence to show that / = it is sufficient to show that / 
(viewed as an element of S (ax a)) vanishes at all (A, n) G Q + x Q + . We will proceed 
by a usual induction on the standard order relation. So suppose that / vanishes at 
all (A ; , fj,') < (A, jti). Consider the GxG module Vx®V^. Let ix denote a if-invariant 
projection onto (V\ <g> V^) K (with respect to a diagonal action). Let F denote the 
operator of left multiplication by / (viewed as an element of U(g x g)). Since Of = 0, 

„.„ — it 1 — n :„ -i-u„ e e — „ „„„„ „f „..™™„„J t „j- „.A / „„ ..Ci 
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denote a non-zero K-invariant vector in V\ (resp. V M ). Then ttF(vj^ <g> v^) = 0. 
Let v\ (resp. u M ) denote the highest weight vector of Va (resp. V M ). By Lemma 1.3 

^"6W /(W ) M 

where Suppt/ lies in Q x Q and for any (A',//) G Suppt/ by induction we have 
/(A', //) = 0. So we obtain that 

f{w'\w"ii){w'vx)®{w"v») 

w'ew /(w ) x 

lies in the kernel of it. Now for any w' G Wq/{Wq)\, w" G Wq/{Wq)^ we can find 
an element (wi(w' ', u/'), W2(w', w")) G VFo x Wo such that wi = yu/, 102 = yw" for 
some y G Wo and such that tuiA + W2fi G Q+. Denote by w\, w\i i = 1, • • • , r the 
complete set of such pairs obtained for all w' G Wq/ (Wo) a, w" G 1^o/(^o)m- Now 
by Wo-invariance of / and by K-invariance of it we proved that an element 

^2 a i f(w{X 1 w» (w\v\) <g) (w % 2 v^) 

i=l,...r 

lies in the kernel of n for some non-zero integers a r . It is sufficient to prove that 
all f(w\X, w l 2 y) are equal to zero. So we reduced our proof to the following claim: 

Claim. Suppose that an element 

i=l, ...r 

Zzes in the kernel of it. Then all hi are equal to zero. 

Suppose that some hi 7^ 0. By Kostant's refinement of PRV conjecture (see 
[J] or [Kul]) for any i the module (Ug) [w{v\) <g> (wfovd] containes a unique Ug- 
submodule of highest weight w\X + w\\i. Denote it heighest weight vector by v l . 
By Kumar's refinement of PRV conjecture (see [J] or [Ku2]), these Ug submodules 

r 

form a direct sum S = © Si. Set 

i=l 

S = © Si. 

l<i<r 

By Density theorem it follows that the module (Ug)A contains 5". Let no denote 
a G-invariant projection (Ug)A — > S. Take i such that the weight w\X + w\\i is 
minimal. Let tt\ denote a G-invariant projection S' — > Si. Then it is clear from the 
above and by checking the weights that 

7Ti7r (A) = cv\ 

where c ^ 0. Denote by tt 2 a K-invariant projection Si — > Sf. Then arguing as 
in proof for one summand we see that 7T27ri7r (A) 7^ 0. But then ir(A) 7^ as well, 
because tt 2 ttitto is K-invariant and hence factors through Tr\( Ug ^ A . This completes 
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